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® Recording and/or reproducing apparatus. 



@ A recording and/or reproducing apparatus in- 
cludes an optical system arranged to form an optical 
image, a photo-electric conversion part arranged to 
convert the optical Imaged into an electrical signal, 
an A/D conversion circuit arranged to convert the 
electrical signal and/or an audio signal into a digital 
signal, a connector arranged to permit mounting and 



demounting a recording medium on which the digital 
signal obtained from the A/D conversion circuit Is to 
be recorded, and a signal processing part for pro- 
cessing and converting the digital signal. The signal 
processing part is arranged to be mountable and 
demountable on and from the apparatus. 



(M 
< 

CM 

in 
rs 



Q. 

UJ 



nuno 

BtPUt OCT 



P80TO- 
UUSG 
IBS 

,7T 
t 



sauna 



UAGE . 



BUS 



on 



A/D -A| 



I BUffEmawiY 



119 



HHiunreus 

COVTBaiB 



ODWHIH— 





HBXADCAlSnTBlL 




unvmocT r 



HASH 

DEvn 



KECaAXEALAHBQPBUmn 

fAETcmmacra 



1»~ 






mxm 








m 



FIG. 1 



EtTEKia /— N HBSl 

CAKO w mtrm 



-Jl. 



KD 



Rank Xerox (UK) Business Services 

0,10/3.09/3. 3.4» 



1 



EP 0 617 542 A2 



2 



Background of the Invention: 
Field of the Invention: 

This invention relates to a recording and/or 
reproducing apparatus arranged to process, record 
and/or reproduce images and sounds. 

Description of the Related Art: 

Fig. 8 shows in a block diagram a conventional 
digital electronic camera. Referring to Fig. 8, the 
digital electronic camera 800 is arranged to use a 
memory card 801 as a recording medium. The 
camera 800 includes a photo-taking lens 1 , a dia- 
phragm shutter 2 which is a shutter, but functions 
as a diaphragm as well, and a flash device 3. A 
CPU 4 is arranged to control mechanical and op- 
eration parts. A driving circuit 5 is arranged to drive 
each part of a mechanical system. An image sen- 
sor 6 is arranged to convert into an electrical signal 
a reflection light which comes from an object of 
shooting. A timing signal generating circuit (abbre- 
viated to a TG circuit) 7 is arranged to generate a 
timing signal necessary for operating the image 
sensor 6. An image sensor driving circuit 8 is 
arranged to amplify the timing signal from the 
timing signal generating circuit 7 up to a level 
necessary for driving the image sensor 6. A 
preprocessing circuit 9 is provided with a CDS 
circuit for removing a noise from the output of the 
image sensor 6 and a nonlinear type amplifying 
circuit for amplifying the output of the image sen- 
sor 6 prior to an A/D (analog-to-digital) conversion 
process. Reference numeral 10 denotes an A/D 
converter and reference numeral 12 a buffer mem- 
ory. A signal processing system control CPU 13 is 
arranged to control each part of a signal processing 
system. An operation display part 14 is arranged to 
make a display in aid of operation by showing the 
state of the camera. An operation part 15 is pro- 
vided for operating the camera from outside. A 
memory controller 802 is arranged to control the 
buffer memory 12. A digital signal processing cir- 
cuit 803 is arranged to make the output of the 
image sensor 6 into a form suited for recording on 
the memory card 801. A memory card interface 
(I/F) 804 is arranged to connect the digital elec- 
tronic camera 800 to the memory card 801. The 
conventional digital electronic camera 800 operates 
as described below with reference to Fig. 8: 

With the operation part 15 operated by a cam- 
era operator, the digital electronic camera 800 en- 
ters into a state of performing a shooting action. 
The photo-taking lens 1 is controlled by the me- 
chanical and operation part control CPU 4 and the 
mechanical system driving circuit 5 in accordance 
with the intention of the operator. At this time, the 



conditions of shooting, etc., are displayed at the 
operation part 15 to inform the operator of the state 
of the camera 800. The luminance of the object of 
shooting is measured by a light measuring circuit 
5 which is not shown. An aperture value and a shut- 
ter speed of the diaphragm shutter 2 are then 
derived from the mechanical and operation part 
control CPU 4. The mechanical system driving 
circuit 5 drives the diaphragm shutter 2 on the 
10 basis of the control values thus derived from the 
CPU 4. Depending on the output of the light mea- 
suring circuit, a shot may be taken by flashing the 
flash device 3. When an exposure is effected in 
this manner, a reflection light from the object of ' 
15 shooting comes to fall upon the image sensor 6 via 
the photo-taking lens 1 and the diaphragm shutter 
2. The diaphragm shutter 2 then acts to limit the 
quantity of the incident light upon the image sensor 
6. If the image sensor 6 is an interlaced reading 
20 type CCD, the diaphragm shutter 2 is arranged to 
prevent an electric charge signal from being af- 
fected by the incident light. The image sensor 6 is 
an-anged to be operated by a driving signal which 
is outputted from the TG circuit 7 and is amplified 
25 by the image sensor driving circuit 8. The action of 
the TG circuit 7 is controlled by the signal process- 
ing system control CPU 13. The output of the 
image sensor 6 which is driven in this manner is 
supplied to the preprocessing circuit 9. Upon re- 
30 ceipt of the output of the image sensor 6, the 
preprocessing circuit 9 performs a CDS (correlated 
double sampling) process to remove a low band 
noise from the output of the image sensor 6 (or a 
pickup image signal) and a process of making the 
35 pickup image signal into a nonlinear state for the 
effective use of the dynamic range of the A/D 
converter 10. The pickup image signal thus 
preprocessed is converted into a digital signal by 
the A/D converter 10. The digital signal thus ob- 
40 tained is inputted to the memory controller 802. 
Under the control of the signal processing system 
control CPU 13, the memory controller 802 at first 
temporarily stores the digitized pickup image signal 
in the buffer memory 12 and then reads out the 
45 stored digital signal in order as determined by the 
arrangement of color filters of the image sensor 6. 
The digital signal thus read out is converted into a 
signal of a predetermined format by the digital 
signal processing circuit 803. The signal thus pro- 
50 cessed is recorded on the memory card 801 
through the memory card interface (I/F) 804. 

The conventional digital electronic camera de- 
scribed above, however, has the following prob- 
lems: 

55 (i) The functions of the camera are limited to 
picking up and recording still images and permit 
neither taking any motion picture nor combining 
with-sound data. 
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(ii) The camera has a limited data compressing 
method for efficient recording on the recording 
medium and does not permit adoption of any 
other method. 

(iii) It is difficult to combine the camera with an 
image pickup device and a sound input/output 
device into a highly advanced information pro- 
cessing apparatus having effective functions in- 
cluding, for example, OCR (optical character 
recognition), voice recognition, voice synthesis, 
translation, image recognition, image synthesis, 
etc. 

Any attempt to overcome these problems, on 
the other hand, would necessitate incorporation of 
all these processing functions into the apparatus. 
Such an attempt, therefore, increases not only the 
size of the apparatus but also its price and would 
become a great demerit of the apparatus for a 
person not requiring such functions. 

Summary of the Invention: 

This invention .is directed to the solution of the 
problems mentioned above. It is an object of this 
invention to provide a recording and/or reproducing 
apparatus which comprises an optical system ar- 
ranged to form an optical image, photo-electric 
conversion means for converting the optical image 
formed by the optical system into an electrical 
signal, A/D conversion means for converting the 
electrical signal arid/or an audio signal into a digital 
signal, a connector arranged to permit mounting 
and demounting a recording medium on which the 
digital signal obtained from the A/D conversion 
means is to be recorded, and signal processing 
means for processing and converting the digital 
signal, the signal processing means being arranged 
to be mountable and demountable on and from the 
recording and/or reproducing apparatus. 

The apparatus arranged in accordance with this 
Invention as an embodiment thereof is arranged to 
permit mounting and demounting not only the re- 
cording medium but also a part of a digital elec- 
tronic camera having some specific function, such 
as a signal processing part, so that the size and 
the price of the digital electronic camera which is a 
basic part of the recording and/or reproducing ap- 
paratus can be minimized and the functions and 
the performance of the apparatus having the cam- 
era as its basic part can be altered as desired. 

The above and other objects and features of 
this invention will become apparent from the follow- 
ing detailed description of embodiments thereof 
taken in conjunction with the accompanying draw- 
ings. 



Brief Description of the Drawings: 

Rg. 1 is a block diagram showing the arrange- 
ment of a first embodiment of this invention. 

5 Fig. 2 is a block diagram showing the arrange- 
ment of an extended card included in Rg. 1. 
Fig. 3 shows a picture dividing action to be 
perfomned by the first embodiment. 
Rg. 4 is a block diagram showing an extended 

10 card arranged in a second embodiment of this 
invention. 

Fig. 5 is a block diagram showing the arrange- 
ment of a third embodiment of this invention. 
Rg. 6 is a block diagram showing an extended 
75 card included in the third embodiment of this 
invention. 

Rg. 7 is a block diagram showing an extended 
card included in a fourth embodiment of this 
invention. 

20 Fig. 8 is a block diagram showing the arrange- 
ment of the conventional apparatus. 

Detailed Description of the Preferred Embodiments: 

25 (First Embodiment) 

A digital electronic camera according to this 
invention is provided with an interface for a record- 
ing medium, a signal processing and compressing 

30 part and an extended card interface having an 
external interface. 

The digital electronic camera according to this 
invention performs a minimum range of functions 
as a digital electronic camera when the extended 

35 card is not mounted on the camera. With the 
extended card mounted, however, the image and 
sound signal processing capability of the digital 
electronic camera is greatly enhanced and also the 
camera gains access to an external interface, so 

40 that a highly advanced system can be formed. 

Fig. 1 shows in a block diagram the arrange- 
ment of a system consisting of the digital electronic 
camera body and the extended card. Rg. 2 shows 
in a block diagram the arrangement of the ex- 

45 tended card. In Fig. 1 , all elements that function in 
the same manner as those of the conventional 
apparatus which is shown in Fig. 8 and described 
in the foregoing are indicated by the same refer- 
ence numerals as in Fig. 8. 

50 Referring to Fig. 1, a recording medium 101 is 
a memory card or a hard disk which conforms with 
the specifications of PCMCIA (Personal Computer 
Memory Card International Association), or the like. 
The camera body 100 includes a sound input cir- 

55 cuit 20 and a sound output part 22 which is either a 
speaker or an audio jack. An A/D (analog-to-digital) 
converter 24 is provided for an audio signal and a 
D/A (digital-to-analog) converter 25 for the audio 
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signal. A switch circuit 21 is provided for the audio 
signal to be supplied to the sound output part 22. A 
memory bus controller 102 is provided for transfer 
of image and sound data between a signal pro- 
cessing system control CPU 13 and an extended 
card 1 1 1 of the PCMCIA Standards or a recording 
medium 101 and also for transfer of image data to 
a buffer memory 12 for an image display. 

A D/A converter 26 is arranged to convert the 
image data of the image display buffer memory 1 2 
Into an analog video signal. A video output part 23 
is provided for displaying the analog video signal. 
An extended bus interface (t/F) 110 is arranged 
between the extended card 111 and the camera 
body 100. 

Referring to Fig. 2, a controller 201 is provided 
for the transfer of digital data on the extended card 
Interface. A digital signal processor (DSP) 202 
(hereinafter referred to as signal processing DSP) 
is arranged to communicate with a host computer 
112 through a compressing/expanding process and 
an external interface. A pickup image signal pro- 
cessing circuit 203 is arranged to perform a pickup 
image signal processing action on unprocessed 
image data. A thinning-out process circuit 204 is 
provided for thinning out the signal processed by 
the pickup image signal processing circuit 203 in 
the vertical and horizontal spatial directions and for 
reducing the number of images per unit time. A 
buffer memory 205 is arranged to temporarily hold 
uncompressed image data. A bus controller 206 is 
arranged to control transfer of data between the 
thinning-out process circuit 204, the signal process- 
ing DSP 202 and an external interface (1/F) control- 
ler 207. The external l/F controller 207 is, for exam- 
ple, an SCSI controller which controls communica- 
tion with an external interface. 

The extended bus interfaces 110 and 201 will 
be hereinafter called the extended bus interface. 

The following describes in detail how each of 
the functions of the embodiment is executed when 
(1) the extended card is not mounted and when (2) 
the extended card is mounted. 

(1) When the extended card is not mounted: 
The signal processing system control CPU 13 per- 
forms control over the whole camera, filing and a 
display of image data and filing and reproduction of 
sound data. The details of the manner in which 
these functions are actually carried out are de- 
scribed as follows: 

(1-1) Monitoring of images to be recorded in an 
image recording mode: When an instruction given 
by the operator for a shift to the recording mode 
through the operation part 15 is detected by the 
mechanical and operation part control CPU 4, the 
signal processing system control CPU 13 makes a 
display of a recording image through the following 
process: 



The signal processing system control CPU 13 
sets the memory bus controller 102 into a mode of 
writing the data outputted from the A/D converter 

6 10 into the image display buffer memory 12. image 
data which has not been subjected to the pickup 
image signal processing action is converted into 
digital data by the A/D converter 10 and is then 
written into the image display buffer memory 12 by 

70 the memory bus controller 102. The digital data 
thus written in the image display buffer memory 12 
is converted into an analog video signal by the D/A 
converter 26. The analog video signal is sent to the 
video output part 23 to be displayed there in a 

15 state which enables the operator to visually confirm 
the recording image as a motion image. The image 
display buffer memory 12 which is provided only 
for a simple display of images does not have many 
picture elements and displays no color information. 

20 Since the display is to be made by using the 
image data which has not been subjected to the 
pickup image signal processing action, the memory 
bus controller 102 is arranged either to extract 
some picture element data which corresponds to 

25 one color, green for example, to use it as a lu- 
minance image or to compute and obtain a lu- 
minance image from information on a plurality of 
colors by a simple filter computing operation. A 
motion image obtained from the image sensor 6 

30 through the above-stated process is displayed at 
the video output part 23. 

(1-2) Image recording: When the mechanical 
and operation part control CPU 4 detects an in- 
struction given by the operator through the opera- 

35 tion part 15 for shooting and recording, the signal 
processing system control CPU 13 controls the 
memory bus controller 102 to cause image data 
which has not been subjected to the pickup image 
signal processing action to be recorded on the 

40 recording medium 101 through the recording me- 
dium l/F (interface) 104. A file structure of MS-DOS 
(Microsoft Disk Operating System) may be em- 
ployed as a recording file format for this. During 
the period of image data transfer for recording and 

45 a predetermined period of time ensuing the record- 
ing, the image being recorded can be held still at 
the video output part 23 if the memory bus control- 
ler 102 gives pause to writing into the image dis- 
play buffer memory 12, so that a still image cur- 

50 rently recorded can be confirmed at the video 
output part 23 by the operator during that period. 

(1-3) Monitoring and recording of sounds in 
recording the sounds: In the recording mode, the 
signal processing system control CPU 13 permits 

55 monitoring the sounds to be recorded by operating 
the switch circuit 21 to connect the output of the 
sound input circuit 21 to the sound output part 22. 
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When the mechanical and operation part con- 
trol CPU 4 detects an instruction given by the 
operator through the operation part 15 for sound 
recording, the signal processing system control 
CPU 13 receives the sound data converted into 
digital data by the A/D converter 24 and transfers 
the digital sound data to the recording medium 
interface 104 through the memory bus coritroller 
102. The recording file format may be of a file 
structure such as that of the MS-DOS. 

When the mechanical and operation part con- 
trol CPU 4 detects the cancellation of the sound 
recording instruction by the operator through the 
operation part 15, or when the signal processing 
system control CPU 13 considers that the sound 
recording is canceled by the lapse of a predeter- 
mined period of time, the process of sound record- 
ing is brought to an end by the signal processing 
system control CPU 13. 

(1-4) Simultaneous recording of images and 
sounds: In recording images and sounds simulta- 
neously, the signal processing system control CPU 
13 holds sound - data received from the A/D con- 
verter 24 within an internal buffer of the signal 
processing system control CPU 13 for a period of 
time during which the images are transferred to the 
recording medium interface 104. When the image 
transfer period expires, the sound data is trans- 
ferred to the recording medium interface 104. One 
field period of . the NTSC system, which is 16.7 
msec, includes a period of about 1.4 msec called a 
vertical blanking„period. during which no video sig- 
nal appears beginning before and ending after a 
vertical synchronizing period. In a case where im- 
age data is to be transferred at an ordinary video 
rate, the image data which has not been subjected 
to the pickup image signal processing action is 
transferred during a period of about 15 msec ex- 
cluding this vertical blanking period. For this pur- 
pose, the data is transferred at a speed rate of 
about 10 Mbyte/sec. 

In sampling the sound data at a frequency of 
22 KHz with one sample consisting of 6 bits, the 
data capacity for 16.7 msec is about 370 bytes. In 
a case where the data is to be transferred in 
remaining 1.4 msec, the transfer must be made at 
a speed of about 260 Kbyte/sec. 

These requirements for the transfer speed can 
be satisfied by using as the recording medium, for 
example, a memory card which conforms to the 
specifications of the PCMCIA or the like. 

As described above, in the case of the digital 
electronic camera of this embodiment, the sound 
data is transferred during the vertical blanking pe- 
riod and the image data during the video period 
within the period of one picture in a time-division 
mutliplexing manner. Recording thus can be ac- 
complished while simultaneously monitoring both 



the images and the sounds. 

In this instance, since the sound data can be 
regarded as information related to the images, the 
images and the sounds can be filed and managed 

5 in pairs. 

Further, the sound data may be transferred 
within a horizontal blanking period of the video 
signal instead of the vertical blanking period. In a 
case where the sound is sampled at 44.1 KHz. 

70 stereophonic and 8 bits, the sound data of a total of 
6 bytes or 4 bytes is transfered and recorded 
within ohe horizontal blanking period. In this case, 
if a hard disk drive (HDD) or the like having a 
mechanical structure is employed as the recording 

J5 medium, the recording is preferably performed in 
such a way as to interieave the sound data for 
every horizontal scanning period. However, in the 
event of a semiconductor memory, tX is not neces- 
sary to interieave the image and sound data for 

20 every horizontal scanning period. In that event, 
interieave recording may be performed for every 
vertical scanning period in such a way as to have 
the sound data recorded before the image data of 
one vertical scanning period. 

25 (1-5) Reproduction of images: When the me- 
chanical and operation part control CPU 4 detects 
an instruction given by the operator through the 
operation part 15 for a shift to a reproduction 
mode, the signal processing system control CPU 

30 13 perfomr^s the following process for reproducing 
and displaying the recording image at the video 
output part 23: 

The signal processing system control CPU 13 
controls the recording medium interface 104 and 

35 the memory bus controller 102 to read out, from 
the recording medium 101. image data which has 
not been subjected to the pickup image signal 
processing action in the same manner as the pro- 
cess of monitoring the recording image as men- 

40 tioned for the function or Para. (1-1) above. Lu- 
minance information is formed by this process and 
the image data thus read out is written in the image 
display buffer memory 12. In this instance, if a 
plurality of sound data have been managed relative 

45 to the image, the sound data can be reproduced by 
the process of a next function described in the 
following paragraph, or function, (1-6): 

(1-6) Reproduction of sounds: When the me- 
chanical and operation part control CPU 4 detects 

50 an instruction given by the operator through the 
operation part 15 for reproduction of sounds, the 
signal processing system control CPU 13 performs 
the following process to reproduce the recorded 
sounds at the sound output part 22: 

55 The signal processing system control CPU 13 
controls the switch circuit 21 to have the output of 
the D/A converter 25 connected to the input of the 
sound output part 22. The signal processing sys- 
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tern control CPU 13 then controls the recording 
mediunn interface 104 and the menriory bus control- 
ler 102 to read out the sound data from the record- 
ing medium 101. The sound data is outputted to 
the D/A converter 25 at the same sampling fre- 
quency as the sampling frequency of recording. 
The sound output part 22 then outputs the sounds. 

(1-7) Imparting sounds to reproduced images: 
With images reproduced by the function (1-5) "Re- 
production of images" and sounds recorded by the 
function (1-3) "Monitoring and recording of sounds 
in recording the sounds", the operator can add 
sounds and voices describing the images while 
watching the recorded images at the video output 
part 23. In this ir^stance, the sound data is man- 
aged and arranged as sound data relative to the 
reproduced images. A plurality of sound data can 
be thus added to the Images. 

(1-8) Reproduction of a plurality of images: 
When the mechanical and operation part control 
CPU 4 detects an instruction given by the operator 
through the operation part 15 for a mode of re- 
producing a plurality of images, the signal process- 
ing system control CPU 13 causes a plurality of 
recorded images to be reproduced and displayed 
at the video output part 23 by carrying out the 
following process: 

Image data is read out from the recording 
medium 101 in the same manner as in the function 
(1-5) "Reproduction of images". The memory bus 
controller 102 thins out luminance information fi- 
nally obtained and transfers it to the image display 
buffer memory 12. This process is carried out for a 
plurality of images. As a result, a multiple picture 
can be displayed, for example, in a manner as 
shown in Fig. 3. In the case of Fig. 3. the lu- 
minance information is thinned out by half in each 
of the vertical and horizontal directions of the pic- 
ture. 

(2) When the extended card Is mounted: The 
extended card functions to perform a pickup image 
signal processing action and compressing and ex- 
panding processes on images and to perform com- 
pressing and expanding processes on sounds. The 
extended card also allows the camera to have 
access to an external interface as well as to the 
recording medium interface 104. 

Therefore, the pickup image signal processing 
action and the compressing and expanding pro- 
cesses can be carried out on the signal obtained 
from the image sensor 6. The form of data on the 
recording medium thus can be changed. The data 
on the recording medium can be transferred to an 
external interface after the form of the data is 
converted into another form as necessary. Data 
from an external interface can be received and its 
form can be changed before recording it on the 
recording medium or returning it to the extemal 



interface. 

The function of "monitoring recording images 
in the image recording mode" is carried out in the 
same manner as when the extended card is not 
5 mounted. Other functions are canried out as de- 
scribed in detail below: 

(2-1) Image recording: When the mechanical 
and operation part control CPU 4 detects an in- 
struction given by the operator through the opera- 
70 tion part 15 for shooting and recording, the signal 
processing system control CPU 13 informs the 
signal processing DSP 202 of commencement of 
image recording and controls the memory bus con- 
troller 102 to have image data which has not been 
75 subjected to the pickup image signal processing 
action transferred to the extented bus interface via 
the recording medium interface 104. Upon receipt 
of the notice of commencement of image record- 
ing, the signal processing DSP 202 initializes the 
20 pickup image signal processing circuit 203 and the 
thinning-out process circuit 204 to ready them for 
receiving unprocessed image data from the ex- 
tended bus interface. 

The image data is processed by the pickup 
25 image signal processing circuit 203 to be con- 
verted into luminance information and color in- 
formation. The output of the pickup image signal 
processing circuit 203 is either thinned out or not 
thinned out by the thinning-out process circuit 204 
30 according to the recording mode. The information 
is then transferred to the buffer memory 205. After 
the luminance and color information is completely 
transferred to the buffer memory 205, the thinning- 
out process circuit 204 informs the signal process- 
36 ing DSP 202 of the completion of the transfer of 
the image data. 

Upon receipt of the notice of completion of 
image data transfer, the signal processing DSP 202 
compresses the data on the buffer memory 205 
40 and controls the extended bus interface, the mem- 
ory bus controller 102 and the recording medium 
interface 104 to have the data recorded on the 
recording medium 101. 

To permit quicker confirmation of the contents 
45 of the image recorded after shooting, the signal 
processing DSP 202 is capable of adding a 
thinned-out image of the compressed image to the 
file of compressed data. With the image assumed 
to be thinned down to 1/8 or thereabout of its 
50 original state longitudinally and transversely, for 
example, the addition of the thinned-down image 
does not cause any excessive increase in the file 
capacity. An image obtained in this manner is 
called an index image. 
55 (2-2) Monitoring and recording of sounds in 
recording the sounds: Sounds are monitored in the 
same manner as in the function (1-3) described in 
the foregoing. When the mechanical and operation 
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part control CPU 4 detects an instruction given by 
the operator through the operation part 15 for 
sound recording, the signal processing system 
control CPU 13 notifies the signal processing DSP 
202 of commencennent of sound recording. The 
signal processing system control CPU 13 receives 
digital data which Is obtained through conversion 
by the A/D converter 24. The digital data is trans- 
ferred to the extended bus Interface through the 
memory bus controller 102. 

The signal processing DSP 202 receives the 
data from the extended bus interface and com- 
presses it. The compressed data is recorded on 
the recording medium 101 through the extended 
bus interface, the memory bus controller 102 and 
the recording medium interface 104. This action Is 
performed during one sampling period of the sound 
data. 

When the mechanical and operation part con- 
trol CPU 4 detects an Instruction given by the 
operator through the operation part 15 to cancel 
the sound recording Instruction, the signal process- 
ing system control CPU 13 notifies the signal pro- 
cessing DSP 202 of termination of the sound re- 
cording. This arrangement may be changed to 
cause the signal processing DSP 202 to terminate 
the sound recording by considering the sound re- 
cording Instruction to be canceled when a predeter- 
mined period of time lapses and to notify the signal 
processing system control CPU 13 of the termina- 
tion of the sound recording. 

(2-3) Simultaneous recording of Images and 
sounds: When the mechanical and operation part 
control CPU 4 detects an instruction given by the 
operator through the operation part 15 for shooting 
and recording, the signal processing system con- 
trol CPU 13 notifies the signal processing DSP 202 
of commencement of recording of images and that 
the Image recording is accompanied by recording 
of sounds. 

The conversion of unprocessed image data into 
uncompressed image data and the transfer of it to 
the buffer memory 205 are carried out in the same 
manner as in the function (2-1) described above. In 
this case, however, the signal processing DSP 202 
does not begin to perform image compressing and 
recording actions until It Is notified of termination of 
sound recording from the signal processing system 
control CPU 13. 

The signal processing system control CPU 13 
controls the memory bus controller 102 In such a 
manner that the Image data Is transferred to the 
extended bus interface, Instead of transferring it to 
the recording medium interface, unlike the function 
(1-4) "simultaneous recording of images and 
sounds". In this case, the signal processing system 
control CPU 13 performs buffering and filing pro- 
cesses on the sound data by time-division mul- 



tiplexing in synchronism with the image transfer by 
the memory bus controller 102 In the same manner 
as the function (1-4). Upon completion of filing the 
uncompressed sound data, the signal processing 

5 system control CPU 13 notifies the signal process- 
ing DSP 202 of completion of the sound recording. 

Upon receipt of the notice of completion of the 
sound recording from the signal processing system 
control CPU 13, the signal processing DSP 202 

70 performs image compressing and recording actions 
In the same manner as In the case of the function 
(2-1). Further, the DSP 202 reads out the uncom- 
pressed sound data recorded by the signal pro- 
cessing system control CPU 13 by controlling the 

75 recording medium Interface 104, the memory bus 
controller 102 and the extended bus interface and 
compresses it by transferring it to the buffer mem- 
ory 205 to an amount allowable by the capacity 
thereof. After compression, the sound data is re- 

20 corded on the recording medium 101 through tiie 
extended bus Interface and the memory bus con- 
troller 102. This action is repeated until all the 
uncompressed sound data is compressed. Upon 
completion of compression, the signal processing 

25 system control CPU 13 erases the file of recorded 
uncompressed sound data from the recording me- 
dium 101. 

(2-4) Transfer of motion Image data and sound 
data to the external interface: The host computer 
30 112 issues an Instruction to the camera of this 
embodiment through tiie external interface for 
transfer of motion image data and sound data to 
the host computer 112. The signal processing DSP 

202 then sets a mode for the memory bus control- 
's ler 102 in such a way as to have the output data of 

the A/D converter 10 always written Into the image 
display buffer memory 12 to enable the operator to 
monitor images at the video output part 23 and. at 
the same time, to have the output data of the A/D 
40 converter 10 supplied to the extended bus inter- 
face. 

(2-4-1) Transfer of image data: The signal pro- 
cessing DSP 202 controls the pickup image signal 
processing circuit 203 and the thinning-out process 

45 circuit 204 In such a way as to receive unproces- 
sed Image data from the extended bus interface. 
The signal processing DSP 202 controls the bus 
controller 206 to have the Image data transferred 
from the thinning-out process circuit 204 to the 

50 external interface controller 207 and also sets a 
mode for the external interface controller 207 to 
receive data from the bus controller 206 and to 
transfer It to an external bus. 

Unprocessed Image data is processed Into lu- 

55 minance Information and color infomnation by the 
pickup Image signal processing circuit 203. The 
output of the pickup image signal processing circuit 

203 is thinned out as necessary by the thinning-out 
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process circuit 204 and tlien is transferred to the 
external interface controller 207. The thinning-out 
process circuit 204 is arranged to notify the signal 
processing DSP 202 of completion of the transfer 
of the luminance and color information to the exter- 
nal interface controller 207 upon completion of the 
transfer for one picture. The signal processing DSP 
202 then notifies the signal processing system con- 
trol CPU 13 of completion of the transfer of the 
image data. 

The signal processing system control CPU 13 
holds the sound data received from the A/D con- 
verter 24 In its internal buffer during the period of 
transfer of the Image data to the external interface 
controller 207. This period is about 15 msec as 
mentioned in the foregoing with respect to the 
function (1-4). A buffer capacity for buffering is 
about 370 bytes. 

(2-4-2) Transfer of sound data: Upon receipt of 
the notice of completion of Image data transfer, the 
signal processing system control CPU 13 allows 
the sound data held in the internal buffer during the 
period of transfer of image data to be transferred to 
the signal processing DSP 202 through the mem- 
ory bus controller 102 and the extended bus inter- 
face. During the period of the transfer of the sound 
data also, the signal processing system control 
CPU 13 holds the data received from the A/D 
converter 24 In the internal buffer thereof. 

When the notice of completion of the transfer 
of image data is received, the signal processing 
DSP 202 changes the bus controller 206 from one 
state over to another in such a way as to allow the 
sound data received from the signal processing 
system control CPU 13 to be transferred to the 
external interface controller 207. 

After completion of the above-stated transfer, 
the function (2-4-1) is performed on the signal of a 
next video field. With the functions (2-4-1) and (2-4- 
2) alternately repeated, the image data and sound 
data are transferred in a state of being time-division 
multiplexed with each other. This action continues 
until some instruction for termination is received 
from the external interface. For example, in a case 
where an SCSI (Small Computer System Interface) 
is employed, the Instruction for termination may be 
obtained with an attention condition generated by 
the host computer 112. 

In order to carry out the above-stated transfer 
without difficulty, the speed of transfer to the exter- 
nal interface must be higher than the maximum 
speed of data generation. In the event of an insuffi- 
cient speed of transfer to the external interface, the 
insufficiency can be offset and covered by thinning 
out the data through the thinning-out process cir- 
cuit 204. In such a case, either the image data is 
spatially thinned or the number of images is 
thinned (reduced) or both of these thinning meth- 



ods may be employed. In the case of thinning the 
number of images, however, the signal processing 
system control CPU 13 must have a targe buffer 
capacity for buffering the sound data. Therefore, 
s this is a matter of trade-off. 

While images and sounds are transferred at the 
same time in the description given above, the 
operation of the embodiment in transferring only 
images or sounds is self-explanatory from the de- 
70 scription given above. 

(2-5) Reproduction of image data on the re- 
cording medium by the camera; When the me- 
chanical and operation part control CPU 4 detects 
an instruction given by the operator through the 
T5 operation part 15 for a shift to the reproduction 
mode, the signal processing system control CPU 
13 notifies the signal processing DSP 202 of the 
instruction for reproduction of images. 

(2-5-1) Reproduction of unprocessed images 
20 on the recording medium: If an image file recorded 
on the recording medium 101 consists of un- 
processed image data, the signal processing DSP 
202 controls the recording medium interface 104, 
the memory bus controller 102 and the extended 
25 bus interface to read the image data from the 
recording medium 101. The image data is supplied 
to the pickup image signal processing circuit 203. 

The image data is processed by the pickup 
image signal processing circuit 203 into luminance 
30 and color information. The output of the pickup 
image signal processing circuit 203 is thinned, if 
necessary according to the image size of the im- 
age display buffer memory 12, by the thinning-out 
process circuit 204 and is transferred to the buffer 
35 memory 205. After completion of transfer of the 
luminance and color information to the buffer mem- 
ory 205, the thinning-out process circuit 204 noti- 
fies the signal processing DSP 202 of completion 
of the transfer. Upon receipt of this notice, the 
40 signal processing DSP 202 transfers the luminance 
information data of the buffer memory 205 to the 
image display buffer memory 12 by controlling the 
extended bus interface and the memory bus con- 
troller 102. 

45 (2-5-2) Reproduction of compressed images on 
the recording medium: In a case where an image 
file recorded on the recording medium consists of 
compressed image data, the signal processing 
DSP 202 reads out the compressed image data 

50 from the recording medium 101 by controlling the 
recording medium interface 104, the memory bus 
controller 102 and the extended bus interface. The 
data of luminance information is expanded and 
thinned if necessary according to the image size of 

55 the image display buffer memory 12. The image 
data is then transferred to the image display buffer 
memory 12 through the extended bus interface and 
the memory bus controller 102. 
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In a case where an index innage is added, the 
expanding process is not necessary. In that case, 
the innage data is thinned or interpolated, or left as 
it is according to the inr^age size of the image 
display buffer memory 12 and, after that, is trans- 
ferred to the image display buffer memory 12 
through the extended bus interface and the mem- 
ory bus controller 102. 

(2-6) Reproduction of sound data on the re- 
cording medium by the camera: When the me- 
chanical and operation part control CPU 4 detects 
an instruction given by the operator through the 
operation part 15 for reproduction of sounds, the 
signal processing system control CPU 13 notifies 
the signal processing DSP 202 of the instruction for 
reproduction of sounds. 

Upon receipt of the notice, the signal process- 
ing system control CPU 13 controls the switch 
circuit 21 to select the output of the D/A converter 
25. 

The signal processing DSP 202 controls the 
recording medium interface 104. the memory bus 
controller 102'^and the extended bus interface to 
read out the sound data. If the sound file consists 
of uncompressed sound data, the sound data read 
out is transferred as it is to the signal processing 
system control CPU 13. If the sound file consists of 
compressed sound data, the sound data is ex- 
panded before it is transferred to the signal pro- 
cessing system control CPU 13. The signal pro- 
cessing systern. control CPU 13 then outputs and 
supplies the sound data received to the D/A con- 
verter 25 at the same frequency as the sampling 
frequency employed at the time of recording. 

(2-7) Transfer of image data on the recording 
medium to the external interface: The host com- 
puter 112 instructs via the external interface the 
camera of this embodiment to transfer image data 
recorded on the recording medium 101 to the host 
computer 112. 

Assuming that the recording medium 101 has 
an unprocressed image file and a compressed im- 
age file recorded thereon, images transferable to 
the host computer 112 are assumed to be in the 
forms of unprocessed images, compressed images 
and uncompressed images. 

If an unprocessed image and a compressed 
image are to be transferred as they are to the host 
computer 112 from the recording medium 101. the 
signal processing DSP 202 reads out the image 
data from the recording medium 101 by controlling 
the recording medium interface 104, the memory 
bus controller 102 and the extended bus interface, 
and transfers the image data to the bus controller 
206 and the externa) interface controller 207. 

In a case where an unprocessed images is to 
be transferred after converting it into an uncom- 
pressed image, the signal processing DSP 202 



causes the pickup image signal processing circuit 
203 to process the unprocessed image data into 
uncompressed image data and transfers it to the 
bus controller 206 and the externa! interface con- 

5 troller 207, in the same manner as in the case of 
the function (2-4-1) described in the foregoing. 

If an unprocessed image is to be transferred 
after converting it into a compressed image, the 
signal processing DSP 202 causes the unproces- 

70 sed image data to be processed into uncompres- 
sed image data by the pickup image signal pro- 
cessing circuit 203 and to be transferred to the 
buffer memory 205, in the same manner as the 
function (2-4-1). The signal processing DSP 202 

75 then compresses the uncompressed image data 
and transfers the compressed image data to the 
bus controller 206 and the external interface con- 
troller 207. 

If a compressed image is to be transferred 

20 after converting it into an uncompressed image, the 
signal processing DSP 202 expands the com- 
pressed image data and, after that, transfers it to 
the external interface controller 207, in the same 
manner as in the case of the function (2-4-2) de- 

25 scribed in the foregoing. 

(2-8) Transfer of sound data on the recording 
medium to the external interface: The host com- 
puter 112 instructs the camera of this embodiment 
through the external interface to transfer the sound 

30 data on the recording medium 101 to the host 
computer 112. 

The recording medium 101 is assumed to have 
an uncompressed or compressed sound file re- 
corded thereon. Sounds are assumed to be trans- 

35 ferred to the host computer 112 in the form of 
uncompressed or compressed sounds. 

In a case where uncompressed sound data and 
compressed sound data are to be transferred from 
the recording medium 101 as they are, the signal 

40 processing DSP 202 reads the sound data out from 
the recording medium 101 by controlling the re- 
cording medium interface 104, the memory bus 
controller 102 and the extended bus interface and 
transfers the sound data to the bus controller 206 

45 and the external interface controller 207. 

If the form of data is to be converted, the 
signal processing DSP 202 reads out the sound 
data by controlling the recording medium interface 
104, the memory bus controller 102 and the ex- 

50 tended bus interface. In converting uncompressed 
sound data into compressed sound data, the signal 
processing DSP 202 compresses the data and 
supplies it to the bus controller 206 and the exter- 
nal interface controller 207. In converting com- 

55 pressed sound data into uncompressed sound 
data, the signal processing DSP 202 expands the 
data and supplies it to the bus controller 206 and 
the external interface controller 207. 



9 



17 



EP 0 617 542 A2 



18 



(2-9) Transfer of image data of the host com- 
puter onto the recording medium: The host com- 
puter 112 issues an instruction to the camera of 
this embodiment through the external interface and 
image data is transferred from the host computer 
112 to the camera to have it recorded on the 
recording medium 101. The image data to be 
transferred from the host computer 112 is in the 
form of an unprocessed image, a compressed im- 
age or an uncompressed image. As for the form in 
which the image data is to be recorded on the 
recording medium 101. the image data is in the 
form of a compressed image. 

In a case where the form of data is not to be 
converted, the signal processing DSP 202 receives 
the image data from the external interface control- 
ler 207 and records it on the recording medium 
101 by controlling the extended bus interface, the 
memory bus controller 102 and the recording me- 
dium interface 104. 

If the form of data is to be converted, the 
signal processing DSP 202 receives unprocessed 
image data from the external interface controller 
207 and transfers the data to the image pickup 
signal processing circuit 203 to form uncompres- 
sed image data at the buffer memory 205. After 
that, the signal processing DSP 202 compresses 
the image data and records the compressed image 
data on the recording medium 101. In some other 
case, the signal processing DSP 202 receives un- 
compressed data and records it on the recording 
medium 101 by compressing it. 

(2-10) Conversion of the form of data of the 
host computer: The host computer 112 instructs 
the camera of this embodiment through the exter- 
nal interface to convert the form of the data trans- 
ferred from the host computer and, after conver- 
sion, to return the data to the external interface. 
The forms of the image data to be transferred from 
the host computer 112 include an unprocessed 
image, a compressed image and an uncompressed 
image. The image data to be returned is in the 
form of a compressed image or an uncompressed 
image. 

The sound data to be transferred from and 
returned to the host computer 112 is in the form of 
compressed sounds or uncompressed sounds. 

In a case where the form of an unprocessed 
image is to be converted, the signal processing 
DSP 202 receives the unprocessed image data 
through the extemal interface controller 207 and 
the bus controller 206. The data thus received is 
transferred to the pickup image processing circuit 
203 to form uncompressed data at the buffer mem- 
ory 205. After that, the uncompressed data formed 
at the buffer memory 205 is returned to the host 
computer 112 through the bus controller 206 and 
the external interface controller 207 either as it Is or 



after compressing it. 

In a case where the form of a compressed 
image is to be converted, the signal processing 
DSP 202 receives the compressed image data 
5 through the external interface controller 207 and 
the bus controller 206 and transfers it to the buffer 
memory 205. After the transfer, the data of the 
buffer memory 205 is expanded and returned to 
the host computer 112 through the bus controller 
TO 206 and the external interface controller 207. 

In converting the form of an uncompressed 
image, the signal processing DSP 202 receives the 
uncompressed image data through the external in- 
terface controller 207 and the bus controller 206 
75 and transfers it to the buffer memory 205. After the 
transfer, the data of the buffer memory 205 is 
compressed and returned to the host computer 112 
by controlling the bus controller 206, the external 
interface controller 207. 
20 In converting the form of sounds, the signal 
processing DSP 202 receives the sound data 
through the external interface controller 207 and 
the bus controller 206 and transfers it to the buffer 
memory 205. The signal processing DSP 202 con- 
25 verts the form of the data of the buffer memory 205 
until the sound data has been completely trans- 
ferred or after an amount of the sound data cor- 
responding to the capacity of the buffer memory 
205 has been transferred. The sound data thus 
30 processed to have its form converted is returned to 
the host computer 112 by controlling the external 
interface controller 207. This process is repeated 
until all sound data existing at the host computer 
112 is processed. 
35 With the extended card used, this function en- 
ables the host computer 112 which has a low 
signal processing capability to process signals at a 
high speed. 

40 (Second Embodiment) 

Fig. 4 is a system block diagram of an ex- 
tended card to be used for the digital electronic 
camera of a second embodiment of this invention. 

45 This embodiment differs from the first embodiment 
only in the internal arrangement of the extended 
card. Referring to Fig. 4, an extended bus interface 
(l/F) controller 201 is provided for the transfer of 
digital data on the extended card interface. A digital 

60 signal processor (hereinafter referred to as DSP) 
202 is anranged to canry out compressing and 
expanding processes and to communicate with a 
host computer through an extemal interface. A digi- 
tal pickup image signal processing circuit 203 is 

55 arranged to perform a pickup image signal pro- 
cessing action on unprocessed image data. A thin- 
ning-out process circuit 204 is arranged to thin out 
a signal which has been subjected to the pickup 
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image signal processing action in the vertical and 
horizontal space directions and in respect of the 
nunnber of Images per unit time. A buffer memory 
205 is arranged to intermediately operate for data 
transfer to be made between an extended bus, the 
thinning process circuit, the DSP and the external 
interface. An external interface controller 207 is, for 
example, an SCSI controller and is arranged to 
control communication with an external bus 401. 
The external bus 401 is arranged to conriect the 
camera of this embodiment with the host computer. 

In the case of the second embodiment, the bit 
width of the extended bus interface is arranged to 
be larger than that of the first embodiment, so that 
the data transfer can be made faster than the first 
embodiment. 

When the extended card is not mounted, the 
second embodiment operates in exactly the same 
manner as the first embodiment. Therefore, the 
following describes the operation of the second 
embodiment to be performed with the extended 
card mounted on the camera body thereof. 

(2-1) Image recording: The same as the image 
recording action of the first embodiment described. 

(2-2) Monitoring and recording of sounds in 
recording the sounds: In recording sounds, the 
sounds are monitored in the same manner as the 
function (1-3) of the first embodiment. When the 
mechanical and operation part control CPU 4 de- 
tects an instruction given by the operator through 
the operation part 15 for recording sounds, the 
signal processing system control CPU 13 notifies 
the DSP 202 of commencement of sound record- 
ing. The signal processing system control CPU 13 
then receives digital data obtained through the A/D 
converter 24 and transfers it to the extended inter- 
face 110 through the memory bus controller 102. 

The DSP 202 receives the data from the ex- 
tended bus interface 201 and compresses the data. 
After that, the compressed data is recorded on the 
recording medium 101 through the extended bus 
Interface 201. the memory bus controller 102 and 
the recording medium interface 104. The DSP 202 
is notified of termination of the sound recording by 
the operation part control CPU 4 through the signal 
processing system control CPU 13 either when 
cancellation of the sound recording instruction giv- 
en by the operator through the operation part 15 is 
detected by the operation part control CPU 4 or 
when the lapse of a predetermined period of time 
prompts the CPU 4 to consider the sound record- 
ing to be canceled. 

(2-3) Simultaneous recording of images and 
sounds: When the operation part control CPU 4 
detects an instruction given by the operator 
through the operation part 15 for shooting and 
recording, the signal processing system control 
CPU 13 notifies the DSP 202 of commencement of 



image recording, indicating, in this instance, that 
the image recording is accompanied by sound 
recording. 

Unprocessed image data is then converted into 

5 uncompressed image data and is transferred to the 
buffer memory 205 in the same manner as the 
function (2-1) of the first embodiment. The DSP 
202 does not begin to perform image compressing 
and recording actions until the DSP 202 receives 

10 notice of termination of sound recording from the 
signal processing system control CPU 13. 

The signal processing system control CPU 13 
controls the memory bus controller 102 in such a 
way as to transfer the image data to the extended 

75 interface 110. The signal processing system control 
CPU 13 then transfers also sound data to the 
extended interface 110, in the same manner as the 
function (2-2) of the first embodiment. The DSP 
202 receives the above-stated data from the ex- 

20 tended bus interface 201 and compresses the data. 
The compressed data is recorded on the recording 
medium 101 through the extended interface 110, 
the memory bus controller 102 and the recording 
medium interface 104. Since the width of the bus 

25 between the camera body is wider than that of the 
first embodiment, the second embodiment has an 
ample transmission capability. Therefore, the sec- 
ond embodiment permits simultaneous Input and 
output of the image data and the sound data in the 

30 manner described above. 

The operation part control CPU 4 notifies the 
DSP 202 of termination of sound recording through 
the signal processing system control CPU 13 when 
cancellation of the instruction given by the operator 

35 through the operation part 15 for sound recording 
is detected or when the operation part control CPU 
4 is prompted to consider the sound recording to 
be canceled by the lapse of a predetermined pe- 
riod of time. After termination of sound recording, 

40 the DSP 202 compresses uncompressed image 
data stored in the buffer memory 205 and records 
the compressed image data on the recording me- 
dium 101 through the extended bus interface 110, 
the memory bus controller 102 and the recording 

45 medium interface 104. 

(2-4) Transfer of motion image data and sound 
data to the external bus: When the host computer 
issues an instruction through the external bus 401 
to the camera of this embodiment to transfer mo- 

50 tion image data arid sound data to the host com- 
puter 112. the DSP 202 sets the memory bus 
controller 102 into a mode in which data outputted 
from the A/D converter 10 is always written into the 
display buffer memory 12 to enable the operator to 

55 monitor images at the video display part 23. The 
DSP 202 also sets a mode in which the data 
outputted from the A/D converter 10 is supplied to 
the extended interface 110. 
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(2-4-1) Transfer of Image data: The DSP 202 
initializes the pickup image signal processing cir- 
cuit 203 and the thinning-out process circuit 204 to 
make them ready for receiving unprocessed image 
data from the extended bus interface 201. The 
unprocessed image data is processed by the pic- 
kup image signal processing circuit 203 into lu- 
Tninance and color information. The information is, 
if necessary, thinned out by the thinning-out pro- 
cess circuit 204 and is transferred to the external 
Interface controller 207 through the buffer memory 
205. 

(2-4-2) Transfer of sound data: The memory 
bus controller 102 generates an interruption into 
the signal processing system control CPU 13 every 
time the transfer of one horizontal scanning amount 
of data comes to an end. The signal processing 
system control CPU 13 causes its internal buffer to 
store therein an audio (sound) signal sampled 
through the A/D converter 24 at a predetermined 
frequency defined by its internal timer. The buf- 
fering amount of the buffer is 4 to 6 bytes per 
horizontal scanning in the case where the sampling 
frequency is 44.1 KHz, stereophonic, and a quan- 
tizing number is 8 bits (the buffering amount is 8 to 
12 bytes if the quantizing number is 16 bits). When 
the interruption from the memory bus controller 
102 is allowed at every horizontal scanning, the 
signal processing system control CPU 13 transfers 
the 4 to 6 bytes of data stored in its internal buffer 
to the DSP 202 through the memory bus controller 
102 and the extended interface 110. The sound 
data is transferred by the DSP 202 to the external 
interface controller 207 via the buffer memory 205. 

Upon completion of this transfer, the process of 
the above-stated function (2-4-1) is executed on the 
amount of video signal of a next horizontal scan- 
ning. 

With the above-stated functions (2-4-1) and (2- 
4-2) incessantly repeated, the image data and the 
sound data are transferred to the external bus 401 
in a time-division multiplexing manner. This action 
continues until an instruction for termination is giv- 
en in one way or another from the external bus. For 
example, if an SCSI is used, the Instruction for 
termination is given with a condition of attention 
generated by the host computer. 

With respect to the point that the speed of the 
externa! bus 401 must be higher than the maxi- 
mum speed of data generation, the second em- 
bodiment is the same as the first embodiment. 
With the maximum transfer-speed of the extemal 
bus assumed to be S (byte/sec), the average 
amount of data per image to be M (bytes), a frame 
rate to be F (frame/sec), the sampling frequency 
for sounds to be f (Hz) and the number of bytes 
per sound sampling to be n (bytes), there is ob- 
tained the following relation: 



SS: M»F + f-n 

Hence, it is apparent that the frame rate is set to 
5 obtain a relation as follows: 

F^ [S-f-n]/M 

It is also apparent that, as an alternative to be 
70 employed as necessary, the thinning-out process 
should be carried out in the spatial directions to 
suppress the average amount of data per image 
frame to obtain a relation which is expressed as 
follows: 

75 

M^[S-f«n]/F 

While the operation of the second embodiment 
to be performed in a case where images and 

20 sounds are to be transferred at the same time has 
been described above, the operation of the em- 
bodiment in transferring only images or sounds is 
self-explanatory from the description given. 

Further, the apparatus of this invention is ca- 

25 pabte of controlling mechanical, operation and op- 
eration display parts related to shooting in accor- 
dance with instructions given from the host com- 
puter 112 through the extemal bus 401 . 

An instruction coming through the external bus 

30 401 is sent to the operation part control CPU 4 
through the external interface controller 207, the 
extended bus interface 201, the memory bus con- 
troller 102 and the signal processing system con- 
trol CPU 13. The instruction is carried out by the 

35 operation part control CPU 4 by regarding data 
thus received as a command. Depending on the 
contents of the command, data stored as internal 
data by the operation part control CPU 4 can be 
sent to the host computer 112 through a reverse 

40 route. Such data relates to, for example, obtaining 
the result of distance measurement, designation of 
focusing, obtaining a current zooming state, setting 
a zooming value, obtaining data of light measure- 
ment, designation of an aperture value, designation 

45 of exposure correction, obtaining the current value 
of exposure correction, commencement or inhibi- 
tion of a process of charging a flash device, com- 
mencement or inhibition of flashing, setting flash 
light distribution characteristic for zooming, obtain- 
so ing voltage value of a power supply disposed with- 
in the camera, finding the states of operation mem- 
bers of the operation part such as a release button, 
a zoom button, a barrier switch, a frame feeding or 
returning button, a shooting mode setting button, 

55 etc., and setting the contents of a display to be 
made at the operation display part. 

Further, by varying a frequency dividing ratio 
and by applying it to the TG circuit 7 from a 
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reference signal transmitter which is not shown, 
motion images can be obtained not only at an 
ordinary video frame rate (30 frames per sec) but 
also at other frame rates such as 15 frames per 
sec. 10 frames per sec, etc. Further, by arranging 
reference signal transmitters of a plurality of dif- 
ferent kinds and by selectively using them to effect 
change-over of the frequency dividing ratio, it is 
also possible to obtain motion images at a frame 
rate other than one integer-th of 30 frames per sec. 

(2-5) Reproduction of image data on the re- 
cording medium by the camera: When the opera- 
tion part control CPU 4 detects an instruction given 
by the operator through the operation part 15 for a 
shift to the mode of reproduction, the signal pro- 
cessing system control CPU 13 notifies the DSP 
202 of the instruction for reproduction of images. 

(2-5-1) Reproduction of unprocessed images 
on the recording medium: The same as the func- 
tion (2-5-1) of the first embodiment described in 
the foregoing, 

(2-5-2) Reproduction of compressed images on 
the recording.; medium: If the image file recorded 
on the recording medium 101 consists of com- 
pressed image data, the compressed image data is 
sent to the buffer memory 205 through the record- 
ing medium interface 104, the memory bus control- 
ler 102 and the extended interface controller 110. 
The DSP 202 expands luminance information data 
Included in the compressed image data and. if 
necessary, performs thinning according to the im- 
age size of the display buffer memory 12. After 
that, the data, is transferred to the display buffer 
memory 12 through the extended interface control- 
ler 110 and the memory bus controller 102. 

In a case where an index image is added, the 
data does not have to be expanded and is sub- 
jected as it is to the thinning-out process or an 
interpolation process according to the image size 
of the display buffer memory 12. After that, the 
data is transferred to the display buffer memory 12 
through the extended interface controller 110 and 
the memory bus controller 102. 

(2-6) Reproduction of sound data on the re- 
cording medium by the camera: The same as the 
function (2-6) of the first embodiment, 

(2-7) Transfer of image data on the recording 
medium to the external bus: The same as the 
function (2-7) of the first embodiment. 

(2-8) Transfer of sound data on the recording 
medium to the external bus: The same as the 
function (2-8) of the first embodiment. 

(2-9) Transfer of image data of the host com- 
puter onto the recording medium: The host com- 
puter 112 issues an instruction through the external 
bus 401 to the camera of this embodiment. Image 
data is then transferred from the host computer 
1 12 to the camera to be recorded on the recording 



medium 101. In this instance, the image data trans- 
ferred from the host computer 112 may be in the 
form of an unprocessed image, a compressed im- 
age or an uncompressed image. The image data 

5 thus received is recorded on the recording medium 
101 in the form of a compressed image. 

In a case where the form of the data is not to 
be converted, the compressed image data coming 
through the external interface controller 207 is re- 

10 corded on the recording medium 101 through the 
extended interface controller 110, the memory bus 
controller 102 and the recording medium interface 
104. 

In a case where the form of data is to be 

75 converted, the unprocessed image data coming 
through the external interface controller 207 is sent 
to the pickup image signal processing circuit 203 
to be converted into luminance and color informa- 
tion in a state of uncompressed image. The output 

20 of the pickup image signal processing circuit 203 is 
sent to the buffer memory 205. The DSP 202 then 
has access to the buffer memory 205 to form 
compressed image data. The compressed image 
data is recorded on the recording medium 101. If 

25 the image data received through the external inter- 
face controller 207 is uncompressed image data, 
the image data is compressed before it is recorded 
on the recording medium 101. 

(2-10) Conversion of the form of data of the 

30 host computer: The host computer 112 issues, 
through the external bus 401 , an instruction to the 
camera of this embodiment to convert the form of 
image or sound data. The image or sound data is 
then transferred from the host computer 112 to the 

35 camera of this embodiment. The form of the data 
thus received is converted and returned to the host 
computer 112 through the external bus 401. 

The conceivable forms of image data to be 
transferred from the host computer 112 include an 

40 unprocessed image, a compressed image and an 
uncompressed image. The conceivable forms of 
image data to be returned include a compressed 
image and an uncompressed image. 

The conceivable forms of sound data to be 

45 transferred from and returned to the host computer 
112 include compressed sounds and uncompres- 
sed sounds. 

In a case where the form of the unprocessed 
image is to be converted, the unprocessed image 

so data coming in through the external interface con- 
troller 207 is sent to the pickup image signal pro- 
cessing circuit 203 and is then stored in the buffer 
memory 205. After that, the uncompressed image 
data of the buffer memory 205 is returned to the 

55 host computer 112 through the external interface 
controller 207 either as it is or after it is com- 
pressed by the DSP 202. 
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In converting the form of a compressed image, 
the compressed Image data coming in through the 
external interface controller 207 Is transferred di- 
rectly to the buffer memory 205. After the transfer, 
the data of the buffer memory 205 is expanded by 
the DSP 202 before it is returned to the host 
computer 112 through the external interface con- 
troller 207. 

In converting the form of an uncompressed 
image, the uncompressed image data coming in 
through the external interface controller 207 is 
transferred directly to the buffer memory 205. After 
the transfer, the data of the buffer memory 205 Is 
compressed by the DSP 202 before it is returned 
to the host computer 112 through the external 
interface controller 207. 

In converting the form of sounds, the DSP 202 
receives sound data through the external interface 
controller 207 and transfers it to the buffer memory 
205. After an amount of the sound data corre- 
sponding to the capacity of the buffer memory 205 
has been transferred, the form of the data of the 
buffer memory 205 is converted. With its form thus 
converted, the data is returned to the host com- 
puter 112 through the external Interface controller 
207. This process is repeated until all the sound 
data on the host computer 112 have been com- 
pletely processed. 

With the extended card employed, this function 
enables the host computer 112 which has a low 
signal processing capability to process signals at a 
high speed. 

(Third Embodiment) 

Figs. 5 and 6 show a camera system arranged 
according to this invention as a third embodiment 
thereof. 

Referring to Figs 5 and 6. an audio signal 
obtained from a sound Input circuit 20 is arranged 
to be supplied to an A/D converter 611 of an 
extended card 1 1 1 through an extended bus Inter- 
face. The A/D converter 611 and a D/A converter 
612 are arranged to have a higher accuracy and a 
wider bit width than an A/D converter 24 and a D/A 
converter 25. A signal processing DSP 202 Is thus 
enabled to handle sound data of a high quality. 

A signal processing system control CPU 13 is 
arranged to control a switch circuit 501 to select 
the output signal of the D/A converter 612, so that 
a high quality sound can be outputted with the DSP 
202 supplying the high quality sound data to the 
D/A converter 612. 

When the extended card is mounted, as de- 
scribed in the paragraph (2) in the foregoing de- 
scription of the first embodiment, the third embodi- 
ment can record and reproduce high quality 
sounds with the audio signal processed by the 



signal processing DSP 202 Instead of by the signal 
processing system control CPU 13. In this in- 
stance, sound data of a large bit number Is of 
course either compressed before filing or filed as it 
5 is. Further, in a case where sound data of a small 
bit width and recorded singly by the camera is to 
be reproduced by using the extended card, the 
sound data can be reproduced with little distortion 
by widening the bit width and by carrying out an 
70 oversampling filter process. 

In Fig. 6 which shows the arrangement of the 
extended card ill. a motion image compress- 
ing/expanding circuit 608 is a compress- 
ing/expanding circuit arranged to to compress, In 
75 real time, uncompressed image data which has 
been processed by a pickup image signal process- 
ing circuit 203 and stored in the buffer memory 
205. While the DSP of the first embodiment is 
arranged to carry out the image compressing or 
20 expanding process by software, the third embodi- 
ment is arranged to have the image compressing 
or expanding process carried out In real time by 
the motion image compressing/expanding circuit 
608. Therefore, the compressing/expanding pro- 
26 cess can be carried out much faster than in the 
case of the first embodiment. A particularly salient 
advantage resides in that, since the compressed 
data can be outputted in real time to an external 
interface controller 207, the data of motion Images 
30 can be transferred even with the transfer speed of 
the external interface allowed to be much slower. 
Further, since compressed data can be expanded 
by receiving it directly from the external interface 
without passing It through the signal processing 
35 DSP 202, the expanding process can be carried 
out at a high speed. 

The signal processing DSP 202 can receive via 
a bus controller 206 the data compressed by the 
motion image compressing/expanding circuit 608 
40 and transmit it to a recording medium 101. In a 
case where compressed data recorded on the re- 
cording medium 101 is to be expanded, the signal 
processing DSP 202 transfers the compressed data 
via the bus controller 206 to the motion image 
45 compressing/expanding circuit 608 to have it ex- 
panded and stored in the buffer memory 205. The 
signal processing DSP 202 thus can read out the 
expanded, uncompressed data from the buffer 
memory 205. Referring to Fig. 6. the output of the 
50 buffer memory 205 is connected to the D/A con- 
verter 610 and to the switch circuit 501 through a 
video encoder 609 and the extended bus interface. 

A signal processing system control CPU 13 is 
arranged to be capable of causing the image 
56 stored in the buffer memory 205 to be displayed 
by controlling the switch circuit 502 in such a way 
as to select the output signal of the D/A converter 
610. A memory having a small number of picture 
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elements is employed as an image display buffer 
memory 12 for the purpose of displaying an image 
in a simple state. However, the buffer memory 205 
is on the other hand arranged to be capable of 
displaying an image consisting of the same num- 
ber of picture elements as an Image sensor 6. The 
display capability thus can be greatly enhanced 
with the extended card 1 1 1 mounted on the cam- 
era body 100. Therefore, in a case where a plural- 
ity of images are to be reproduced and displayed, 
the third embodiment is capable of enabling the 
operator to see more images than in the case of 
the first embodiment. 

Further, a display of a simple image can be 
made at a video output part 23 with the switch 
circuit 502 controlled in such a way as to select the 
output signal of a preprocessing circuit 9. In this 
case, electric energy can be saved by stopping the 
supply of power to a part including the A/D con- 
verter 10. the memory bus controller, 102, the 
buffer memory 12 and a D/A converter 26. 

The parts of the third embodiment arranged to 
have a stronger functions than those of the first 
embodiment, such as the sound A/D and D/A con- 
verters having a wider bit width, the compression 
circuit having the motion image compressing func- 
tion, the video encoder of the buffer memory, of 
course do not have to be actually included all at 
once in the system but they can be individually 
installed as desired. 

(Fourth Embodiment) 

Fig. 7 is a block diagram showing by way of 
example the arrangement of an extended card em- 
ployed in a fourth embodiment of this invention. In 
Fig, 7, reference numerals 111 to 612 denotes 
blocks which are identical with those of Fig. 6. 
Reference numeral 701 denotes a reduced instruc- 
tion set computer (RISC) CPU. A program RAM 
702 is arranged to store an operation program of 
the RISC CPU 701. A flash ROM 703 is arranged 
to store the basic input and output system (BIOS) 
of the RISC CPU 701 . The operation of the fourth 
embodiment is described with reference to Figs. 5 
and 7 as follows: 

In the case of the fourth embodiment, a record- 
ing medium 101 in which a program of the BIOS 
level of the RISC CPU 701 is written is first moun- 
ted on the camera part 100 of Fig. 5. The contents 
of the recording medium 101 are transferred to the 
extended card 111 through a recording medium 
interface 104 and an extended interface 110 under 
the control of a memory bus controller 102. At the 
extended card ill, the RISC CPU 701 controls the 
program data transferred from the camera part 100 
to be written into the flash ROM 703 through the 
extended bus interface. This action makes it possi- 



ble to have the functions and the performance of 
the digital electronic camera at its BIOS level to be 
variable with the extended card 111 mounted on 
the camera part 100. The camera can be improved 

5 to a great extent by this without replacing the 
whole camera part. Next, a medium in which an 
application program to be run on the RISC CPU 
701 is written is mounted as the recording medium 
101. This application software (program) is likewise 

10 written into the program RAM 702 of the extended 
card 1 1 1 through the extended bus. By doing this, 
it becomes possible to have application software of 
varied kinds selectively run on the digital electronic 
camera. In other words, with the extended card 

75 mounted, video and audio signals transferred from 
the camera part 100 can be processed not only in 
the same manner as in the case of the third em- 
bodiment but also in a more highly sophisticated 
manner according to the contents of the programs 

20 written in the program RAM 702 and the flash ROM 
703. 

For example, by writing a character recognition 
program in the program RAM 702, a character 
image which is picked up by the camera can be 

25 processed by the RISC CPU 701 to convert it into 
text data to have it stored in a program RAM, 
including programs related to the software of trans- 
lation, image recognition, image synthesis, etc. 
While the fourth embodiment has been de- 

30 scribed as having the recording medium 101 con- 
nected to the camera as a supply source of a 
processing program or a BIOS, the processing 
program may be supplied from some other in- 
formation apparatus such as a personal computer 

35 through the SCSI bus of the extended card. 

The fourth embodiment is arranged as de- 
scribed above to use the RISC CPU as a processor 
which permits a high speed computing operation. 
However, the RISC CPU of course may be re- 

40 placed with some other processor, such as a CISC 
(complex instruction set computer) CPU or the like. 

While this invention has been described in 
detail through some preferred embodiments there- 
of, this invention is not limited to the embodiments 

45 described. Various changes and modifications of 
these embodiments of course may be made with- 
out departing from the spirit and scope of the 
invention. 

The main features of this invention are briefly 
50 described as follows: 

The invention provides a low-priced recording 
and/or reproducing system when nothing is con- 
nected to the extended interface of the system. 

Further, while such units that require a large 
55 investment and much labor in developing them, 
such as the optical and image pickup parts, are left 
to be employed in common, the invention provides 
a system most apposite to the desire of the users 



15 



29 



EP 0 617 542 A2 



30 



by varying the functions of the units to be inserted 
into the extended interface. Therefore, a system 
which Is not expensive as a whole can be obtained 
In accordance with this invention. 

A recording and/or reproducing apparatus In- 
cludes an optical system arranged to form an op- 
tical Image, a photo-electric conversion part ar- 
ranged to convert the optical imaged into an elec- 
trical signal, an A/D conversion circuit arranged to 
convert the electrical signal and/or an audio signal 
Into a digital signal, a connector arranged to permit 
mounting and demounting a recording medium on 
which the digital signal obtained from the A/D con- 
version circuit is to be recorded, and a signal 
processing part for processing and converting the 
digital signal. The signal processing part is ar- 
ranged to be mountable and demountable on and 
from the apparatus. 

Claims 

1. A recording and/or reproducing apparatus 
comprising: 

a) an optical system arranged to form an 
optical image; 

b) photo-electric conversion means for con- 
verting the optical image formed by said 
optical system into an electrical signal; 

c) A/D conversion means for converting the 
electrical signal and/or an audio signal into 
a digital signal; 

d) a connector arranged to permit mounting 
and demounting a recording medium on 
which the digital signal obtained from said 
A/D conversion means is to be recorded; 
and 

e) signal processing means for processing 
and/or converting the digital signal, said sig- 
nal processing means being arranged to be 
mountable and demountable on and from 
said recording and/or reproducing appara- 
tus. 

2. An apparatus according to claim 1, wherein 
said recording medium includes a semicon- 
ductor memory. 

3. An apparatus according to claim 1, wherein 
said signal processing means includes first 
communication means for communication with 
an external computer. 



5. An apparatus according to claim 1, wherein 
said signal processing means includes com- 
pressing means for compressing an input digi- 
tal signal. 

6 

6. An image pickup apparatus comprising: 

a) an optical system arranged to form an 
optical image; 

b) photo-electric conversion means for con- 
10 verting the optical image formed by said 

optical system into an electrical signal; 

c) A/D conversion means for converting the 
electrical signal and/or an audio signal into 
a digital signal; and 

75 d) signal processing means for processing 

and/or converting the digital signal, said sig- 
nal processing means being arranged to be 
mountable and demountable on and from 
said image pickup apparatus. 

20 

7. An apparatus according to claim 6, wherein 
said signal processing means Includes first 
communication means for communication with 
an external computer. 

25 

8. An apparatus according to claim 7, wherein 
said signal processing means further includes 
second communication means for communica- 
tion with a computer disposed within said im- 

30 age pickup apparatus. 

9. An apparatus according to claim 6, wherein 
said signal processing means includes com- 
pressing means for compressing an input digi- 

35 tal signal. 

10. An apparatus according to claim 1 or 6, 
wherein said signal processing means is in a 
card-like shape. 

40 

11. An apparatus according to claim 10, wherein 
said signal processing means is arranged in 
conformity with the specifications of the 
PCMCIA (Personal Computer Memory Card In- 

45 ternal Association). 

12. An apparatus according to claim 1 or 6, 
wherein said signal processing means includes 
an RISC (reduced instruction set computer) 

50 CPU. 
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4. An apparatus according to claim 3, wherein 
said signal processing means further includes 
second communication means for communica- 55 
tion with a computer disposed within said re- 
cording and/or reproducing apparatus. 
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